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Abstract. A relationship between two old mathematical subjects is observed: the 
theory of hypergeometric functions and the separability in classical mechanics. Sep- 
arable potential perturbations of the integrable billiard systems and the Jacobi prob- 
lem for geodesies on an ellipsoid are expressed through the Appell hypergeometric 
functions F4 of two variables. Even when the number of degrees of freedom in- 
creases, if an ellipsoid is symmetric, the number of variables in the hypergeometric 
functions does not. Wider classes of separable potentials are given by the obtained 
new formulae automaticaly. 



1. Introduction 

Appell introduced four families of hypergeometric functions of two variables in 
1880's. Soon, he applied them in a solution of the Tisserand problem in the celestial 
mechanics. The Appell functions have several other applications, for example in the 
theory of algebraic equations, algebraic surfaces... The aim of this paper is to point 
out the relationship between the Appell functions F4 and another subject from 
classical mechanics - separability of variables in the Hamilton - Jacobi equations. 

The equation 

(1) XV^y + 3 [yV, - XVy) + - X^)V,y + Xy {V^^ - Vyy) = 0, 

appeared in Kozlov's paper [1] as a condition on function V = V{x,y) to be an 
integrable perturbation of certain type for billiard systems inside an ellipse 

(2) T+B=^' ^ = ^-^- 

This equation is a special case of the Bertrand-Darboux equation [2,3,4] 

i^yy ~ '^xx)i - '2axy - h'y - hx + ci) + 2Vxy{ay'^ - ax^ + by -b'x + c- c') 
+ 14(6ay + 3b) + Vy{-6ax - 3b') = 0. 

It corresponds to the choise a = —1/2, b — b' = ci ~ 0, c — c' = —A/2. The 
Bertrand-Darboux equation represents the necessary and suficient condition for a 
natural mechanical system with two degrees of freedom 
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to be separable in the elliptical coordinates or some of their degenerations. 

The solutions of the equation (1) in a form of the Laurent polynomials in x, y 
were described in [5]. The starting observation of this paper, that such solutions 
are simply related to the well-known hypergeometric functions of the Appell type 
is presented in the section 3. Such a relation automatically gives a wider class of 
solutions of the equation (1). But what is more important, it shows the existence of 
the connection between separability of the classical systems on one hand, and the 
theory of hypergeometric functions on the other one. The basic references for the 
Appell functions are [6,7,8]. Further, in section 3, the similar formulae for potential 
perturbations for the Jacobi problem for geodesies on ellipsoid from [9] and for the 
billiard systems on the surfaces with constant curvature from [10], arc given. 

In the case of more than two degrees of freedom, the natural generalization for 
the equation (1) is system (4). The system (4) for the three degrees of freedom was 
derived in [11] in a connection with the billiard systems inside an ellipsoid in R"^ and 
the Laurent polynomial solutions were given. In section 4, we express these solutions 
for a symmeric ellipsoid through the hypergeometric functions. Surprisingly, we 
obtain again the Appell hypergeometric functions of two variables. The number 
of degrees of freedom increased but the number of variables of the hypergeometric 
functions didn't! 

The system 



(a, - ttr) ^ {xfVrs - XiXrVis) = (fl^ - O^) ^ {xfVrs - XiXsVir) i r s i; 



(4) 



+ Vir 



Vir 



where Vi = dV/dxi, of (n — 1)(2) equations was formulated in [12] for arbitrary 
number of degrees of freedom n. In [12] the generalization of the Bertrand-Darboux 
theorem was proved. According to that theorem, the solutions of the system (4) 
are potentials separable in generalized elliptic coordinates (see the Theorem after 
lemma 2, below). 

Some deeper explanation of the connection between the separability in the elliptic 
coordinates and the Appell hypergeometric functions is not known yet. 
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2. Basic notations 

The function F4 is one of tlie four liypergeometric functions in two variables 
introduced by Appell [8,7] and defined as a serries: 

F, (a, b, c, d; x,y) = J2 (e)^(rf)„ ^ ^' 

where (a)„ is a standard Pochhammer symbol: 

, , T(a + n) / ix , 1N 
{a)n = ^ , . =a{a+l)...{a + n-l), 
i [a) 

{a)o = 1, 

(For example ml = (l)m-) 

The series F4 is covergent for ^/x + ^/y < 1. The functions F4 can be continued 
to the solutions of the equations: 

dF 

-{a + b+l)y—-abF = Q, 
dy 

,d^F ^d^F „ d^F , , , , ,dF 
^(1 - 2/) - -V - + [c' - (« + + 1)2/]^ 

dF 

- (a + 6 + \)x- abF = 0, 

ox 



3. The separable systems with two degrees of freedom 
Billiard inside an ellipse 



Following [1,5] we will start with a billiard system which describes a particle 
moving freely within an ellipse (2). At the boundary we assume elastic reflections 
with equal impact and reflection angles. This system is completely integrable and 
it has an additional integral 

y2 [xy-yxY 
^'=A + B- AB ■ 

We arc interested in a potential perturbations V = V{x, y) such that the pertur- 
bated system has an integral Ki of the form 

Ki = Ki + ki{x,y), 

where ki = ki{x,y) depends only on coordinates. This specific condition leeds to 
the equation (1) on V (see [1]). 
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In [5] the Laurent polynomial solutions of the equation (1) were given. The basic 
set of solutions consists of the functions 



fe-2 fe-i-1 



Vk = Y,{-iy ^ Uk^,ix,y,\,a)+ay 2^ keN, 

i=0 s=l 
fc-2 k-i-1 

^'fe = E E i-^rUkisiy,x,\,a)+ax-^'', k€N, 



=0 s=l 



S + z-l\[l-{k-i)][2-ik-i)]...[s-{k- i)] _2s,,-2k+2i 



2k 



where 



Ukis = ( , ) ^ ^ '-^ ^ '-^ax^'y 

Now, we are going to rewrite the above formulae: 

fc-2 k-i-1 

Vk = Y.{-iy E Ukis{x,y,X,a)+ay-^\ k&N 

i=0 s=l 

= Vr-ir ' r(s + j)r(5 + i-fc + i) 2. 2(»-fc) - 
h h r(i + i)r(s)r(i-fc + i)r(s + i) ^ 

2'^'^" Ws+i{2-kuax'r{-yy \ 

= ^ {xF4{l; 2-k; 2, l-k, X, -y) + 1) , 

where x = , y = — y^, and F4 is the Appell function. We just obtained the simple 
formula which expresses the potentials Vk, for k ^ N from [5] through the Appell 
functions. We can use this formula to spread the family of solutions of the equation 
(1) out of the set of the Laurent polynomials. 

Let V{x,y) = Yli^nmX^y"^ ■ Then the equation (1) reduces to 



(5) nman,m = {n + m){man-2,m - nan,m-2)- 

If one of the indices, for example the first one, belongs to Z, then V doesn't have 
essential singularities. Put 00,-27 = 1, where 7 is not necessary an integer. 
If we define 

(6) «2s + 2,2i-£y - (2),(1 - 7),^^! " 



it can easily be seen that (6) is a solution of the eqation (5). So, let us denote 
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(7) = y-^ {xF4l, 2 - 7, 2, 1 - 7, i, y) + 1) . 

Then we have 

Theorem 1 Every function given with (7) and ^ & C is a solution of the 
equation (1). 

Mechanical interpretation: with 7 G R~ and the coefficient multiplying V-y posi- 
tive, we have potential barrier along x-axis; so we can consider a cut along negative 
part of y-axis. 

The Jacobi problem for geodesies on an ellipsoid 

The Jacobi problem for the geodesies on an ellipsoid 

ABC 

has an additional integral 

2 2 2 -2 -2 -2 

The potential perturbations V = V{x^ y, z) such that perturbated systems have the 
integrals of the form 

ki=Ki+ k{x, y, z) 
satisfy the following system (see [9]) 

y^ A-B _ y_V^ -xfLYl. ( ^ _ l!.^ V 

+ - -^-^^ + -^A^^ +[a^~B^) ^^y^ 

(^vv ^xx\ , zx zy 



^ Ab[ A B r CA^ CB^ 



(8) 



+ 



y 

yz fv^ 

BC\ B 



z 

CP 
C 



B-C 



BC 
xy 



+ 



B 

'■ AC^ 



52 c 



_B3 } ^v- 



\A^ + 52 + c2 j AC A^ C^ C-' A^\C^~ A^) ^'""^ 

^ AC\C A )^ BC^ BA^ 

The system (8) replaces in this problem the equation (1). The solutions of the 
system in the Laurent polynomial form were found in [9]. We can transform them 
in a following way. 
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Vi,{x,y,z)= Yl (-1) 
o<fe<s,fe+c<;o 



k 



c^+'^ic - aYic - hf2^+^{-h + 1) . . . (-^0 + (fc + s)) 



E 



h^a^ih - a)fc+^2^2'=s!(-;o + 1) . . . {-h + k) 

{s + k- iy.{-lo + l){-lo + 2),+fe_i(z2)'o ra;2c(a - c) 



k\{s-l)\s\{-lo + l)k{x^y'> 



2:^(6 — a)a 



y^c{c-b) 
z^{b-a)b 



(l)s+fe-l(-'o + 2)s+fe_i 

X y 



(2),_i(-/o + l)fc 



2 \ '0 



= (-'o + 1) 1 ^ ) ^4(1; -^0 + 2; 2, -^0 + 1, X, y), 



where 



X c{a - c) _ ^ y c{c -b) _ ^ 
X, „ rr — y 



z'^{b — a)a ' z^{b—a)b 
In the above formulae Iq was an integer. We have strightforward generahzation: 

Theorem 2. For every 7 G C the function 

,2 \ 7 



X^ 



y^ = (-7+l) ^ Jk(l;-7 + 2;2,-7+l,^,^), 



is a solution of the system (8). 



Billiard systems on the constant curvature surfaces 

Potential perturbations of the billiard systems on the constant curvature surfaces 
were analysed in [10]. Following the notation from [10], let the billiard Ds be a 
subset of the surface Sg, of the curvature iS' = +lorS' = — 1, bounded with the 
quadric Qs, where 

S+ = {r = {x,y,z) e \ {r,r)+ = 1}, (ri,r2)+ = xit/i +X2y2 + X3ys; 

S_ = {r = {x,y,z) e \ {r,r)- = -1, z> 0}, (ri,r2)- = xiyi + 2:22/2 - xays; 

111 



Qs = Ss n {r G i?^ I (Or,r), = 0} ^ 0, Q = diag 



Then the billiard system has the integral 



A' B' C 



{xy-yxf Jxz - zxf Jzy - yzf 
^= AB +^ AC +^ BC 

As before we are looking for potentials V = V{x,y,z) such that the pertubated 
system has an integral of the form 

K = K + k{x,y,z). 
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In this case the condition is given by the system [10] : 

3Ct/14 - ^CxVy + V^y{C{y'' - a;2) + Kz'^{B - A)) 
+ cxyVxx - cxyVyy + azyV^x - bzxV^y = 0, 



SBzVx - KWxV, + - + Ky'^iC - A)) 

+ BzxVxx - KBzxV^^ + AzyVxy - KCyxVy^ = 0, 

ZAzVy - K3AyV, + Vy,{A{z^ - Ky^) + Kx'^{C - B)) 

+ AzyVyy - KAzyV^^ + BzxV^y - KCxyV^z = 0. 

Starting from the solutions from [10] 

V, — ^_ n , ^2m 2io-2-2fe-2m 2/s 

•^'o ~ r2(o am,kX y Z , 



where 
we come to 



^ 0<k<lo-l 
0<m<lo-k-l 



_ (C-B\" (lo-k-l\(k + m-l\ ( A- B 



C-A \ m \ k J \C-AJ ' 



Theorem 3. The functions 

= y-^x^Fiil, 2 - 7, 2, 1 - 7, X, y) + 1), 

where 

x^{B - C) _ . z^{A-B) _ , 
y2(C-A) ^y^C-A) -y 

are solutions of the system (10), for "f ^ C. 



4. More than two degrees of freedom 

In the previous section we saw that the integrable perturbations of separable 
systems with two degrees of freedom led to the hypergeometric functions of two 
variables. Now, one can expect that in a case of more than two degrees of freedom, 
the integrable potentials are connected with the hypergeometric functions again, 
but with more than two variables. We will consider the billiard system inside an 
ellipsoid in , and wc will sec that corresponding potential perturbations are still 
related to the Appell function of two variables, if the ellipsoid is symmetric. 

Billiards inside an symmetric ellipsoid in B? 

Let us consider the billiard system within an ellipsoid in E? 
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Potential perturbations W = W{x,y,z) of such systems in a form of the Laurent 
polynomials were calculated in [11]. They satisfy the system (4) for n = 3. 



(11) wt, = ^ 

where 



0<m-\-n-\-k<lo 



m!n!(Zo - 1 - A; - m - n)! 7™+*^/?"+'= 



and /3 = S - C, ^ = C - A. 

The symmetric case A = B corresponds to the condition 7 + /3 = 0. 



Lemma 1. If'y + (3 = then we have 



(12) 



Proof. 



i=0 

k 



i=0 



m + k — i — l\fn + i — 1 
k — i 



k — i + m — l\fi + n— 1\ /fc + m + n— l\;. 



k — i 



k 



(3\ 



By putting (12) into (11) we get, using 7 = —(3 

(/o - 1) . . . (^0 - m - n - k){m + n + k- 1)!(-1)" x™ y" z'' 



C 



(?o-l)...(?o-A:)(m + n-l)! 



{zf 



m+n+fc— 1 

'° (-?o + 2) . . . (-/o + m + «. + A;)(l)„,+„+fe_i z'^ 



E 



^ i-lo + 1) . . . (-/o + fc)(-l)-™(l)™+„_i m! n! fc! 



to! n\ k\ 
+ 1 



where x = ^, y=^, z= ^. 



Wi,=C-z-'°i E 



(l)m+ri+fe-l (2 - Zo) (-1)™ z 



1 



Vm+n+fc— 1 
lo 



ci-'o E 

\m+n4'^— 1 



(l)m+„_i(l - /o)/c to! n! A:! ^ 

(l)™+„+fe_i(2 - Zo)™+„+fc-i(-l)™(TO + n)! x" z'^ 



(2)„+„_i(l - ;o)fe(w + n - 1)! TO,! n! /c! 



_^ '-io ( (l)Tn+«+/c-l(2 - ?o)m+n+fc-l (-X + y)'"+" i*' 

Utr.=i (2W-i(l-M. (m + n-l)!A! ^ 



(-x + y) E 



o<s+fe<;o 



(l).,+fc(2 - ;o)^+fc (-X + yY z'' 
(2),(l-Zo)fc s\ k\ 
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where C = (1 — /o)7~'°, m + n — 1 = s. 

Theorem 4. Generalizations of the integrable potential perturbations from [11] 
in the symmetric case are given by: 

Wio = (z)-^" [i-x + y)F4(l, 2 - Zo; 2, 1 - W, -x + y,z) + l], 

where Iq G C. 

The case of general dimension 

We consider biUiard system in ii" within an elHpsoid 

— + ••• + — = 1. 

ai an 

For n > 3 wc start from a separable system with n integrals Ki, ...,Kn which are 
mutualy in involution, where Kn = H is a Hamiltonian and 

(13) j^.^yiii^^i^ij^ i = l,...,n-l. 

Then we are interested in potential perturbations fci, fc„, where ki = ki{x\, ...,Xn) 
depend only on coordinates and V = kn- The conditions 

(14) {kn,ki} = Q, i=l,...,n-l, 
where 

(15) Ki = Ki + ki, i = l,...,n, 

are equivalent to the system (4). Nontrivial (and maybe unexpected) fact is that 
new integrals commute between themselves. 

Lemma 2 From (13) and (14), it follows that 

{kj,ki} = 0, i,j = l,...,n-l. 

This was checked by direct calculation for n = 3 in [11], but in general case it 
follows from the generalized Bertrand- Darboux theorem proved in [12]: 

Generalized Bertrand-Darboux Theorem [12] For a natural Hamiltonian 
system with a Hamiltonian 

1 " 
^ i=i 

the following three conditions are equivalent: 
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(a) It has n — 1 global, indipenderit, involutive integrals of the fonn (15). 

(b) The potential V satisfies the system (4)- 

(c) The Hamilton - Jacobi equation for H is separable in generalized elliptic coordi- 
nates (ui,...,u„) given by 



Theorem 5 Integrable potential perturbations of the billiard systems inside a 
symetric ellipsoid in R"' for arbitrary n G N are given with 

= pi + • • • + Xn-x)Fi{\, 2 - fc; 2, 1 - fc; ^1 + • • • + f„) + 1] 

for any k G C. 

5. Conclusion 

If we denote in (11) — /3/7 as q, then, theorem 4 shows that the potentials Wi^ are 
certain deformations of the (Appell) hypergeometric functions. The analysis of this 
deformation and comparison to the known g- deformations and gcnoraisations of the 
hypergeometric functions multivariable ([6]) remains as an interesting problem. 

Potential perturbations of the classical nonholonomic rigid body problems are 
described in [13]. It looks that they are also connected with the hypergeometric 
functions. 

Prom geometric point of view, it is well known that the billiard systems within 
an ellipse are closely related to the Poncelet and the Cayley theorem [14-16]. So, 
the Appell hypergeometric functions define natural deformations of these classical 
projective geometry settings. 
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